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f-H , Summary The quasi-likelihood estimator and the Bayesian type estimator of the volatility parameter are in 

■ general asymptotically mixed normal. In case the limit is normal, the asymptotic expansion was derived in [28] 
(-H , as an application of the martingale expansion. The expansion for the asymptotically mixed normal distribution 

is then indispensable to develop the higher-order approximation and inference for the volatility. The classical 
approaches in limit theorems, where the limit is a process with independent increments or a simple mixture, 
do not work. We present asymptotic expansion of a martingale with asymptotically mixed normal distribution. 
The expansion formula is expressed by the adjoint of a random symbol with coefficients described by the Malli- 

■ avin calculus, differently from the standard invariance principle. Applications to a quadratic form of a diffusion 
! process ("realized volatility") are discussed. 

, Keywords and phrases Asymptotic expansion, martingale, mixed normal distribution, Malliavin calculus, ran- 

■ dom symbol, double Ito integral, quadratic form. 

d- 

T— I \ 

! 1 Introduction 

The asymptotic expansion is a tool to give a precise approximation to the probability distribution. As commonly 

■ well known, it is the basement of the contemporary fields in theoretical statistics such as the asymptotic 
$-H \ decision theory, prediction, information criterion, bootstrap and resampling methods, information geometry, 

and stochastic numerical analysis with applications to finance, as well as the higher-order approximation of 
distributions. The methodology of the asymptotic expansion has been well established, and historically well 
developed especially for independent observations ([2]). 

For stochastic processes, there are two principles of asymptotic expansion. The first one is the mixing 
approach. It is also called the local approach because it takes advantage of the factorization of the characteristic 
function by the Markovian property more or less, and corresponds to the classical asymptotic expansion for 
independent models. A compilation of the studies for Markovian or near Markovian chains is Gotze and Hipp 
[5]. The local nondegeneracy, that is, the decay of each factor of the characteristic function becomes an essential 
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problem, and Gotze and Hipp [6] showed it for time series models. For continuous time, Kusuoka and Yoshida 
[12] and Yoshida [30] treated the e-Markovian process to give asymptotic expansion under the mixing condition. 
Then the local nondcgeneracy of the Malliavin covariance works for objects expressed by the stochastic analysis. 
Though this method is relatively new, there are already not a few applications: expansion for a functional 
of the e-Markov processes, statistical estimators, information criterion, stochastic volatility model, empirical 
distribution ([20], [24], [14], [13] among others). 

Although the local approach is more efficient when one treats mixing processes, the asymptotic expansion 
for the ergodic diffusion was first derived through the martingale expansion ([28], [19], [29]). When the strong 
mixing coefficient decays sufficiently fast, under suitable moments conditions, the functionals appearing as the 
higher-order terms in the stochastic expansion of the functional bear a jointly normal limit distribution and it 
yields a classical expansion formula each of whose terms is the Hermite polynomial times the normal density. 
On the other hand, if we consider the sum of quadratics of the increments of a diffusion process, it is observed 
that in the higher-order, the variables have a non-Gaussian limit even when the sum is asymptotically normal 
in the first order. Such phenomenon is observed in the estimation of the statistical parameter in the essentially 
linearly parametrized diffusion coefficient. Due to the non-Gaussianity, we cannot apply the mixing approach 
in this case. Nonetheless, the martingale expansion can apply to obtain the expansion for the estimator of the 
volatility parameter; see [28]. This example shows that the martingale expansion is not inferior to the mixing 
method but even superior in some situations. 

Estimation for the diffusion coefficient has been attracting statisticians' interests. There are many studies in 
theoretical statistics such as [3], [17], [18], [27], [11], [22], [8], [23], [21] among others. The estimators, including 
the so-called the realized volatility, are in general asymptotically mixed normal; see for example [3], [4], [7], 
[25]. Today vast literature about this topic is available around financial data analysis. We refer the reader to 
[1] and [16] and references therein for recent advances in the first-order asymptotic theory and access to related 
papers. The statistical theory for mixed limits is called the non-ergodic statistics since the Fisher information 
and the observed information are random even in the limit, differently from the classical cases where those are 
a constant. In this sense, it may be said that the mixing approach belongs to the classical theory. As for the 
asymptotic expansion in non-ergodic statistics, it seems that there is room for study. 

In order to explain the technical difficulties in this question, let us recall the method in the proof of the 
martingale central limit theorem and the classical martingale expansion. Let M" = (M")(g[o_i] be a continuous 
martingale; it is possible to consider more general local martingale but the existence of jumps for example does 
not change the situation essentially. Under the condition that (Af")i -^"p 1 as ti — > oo , it suffices to show that 

i;[e™^^"]e^"' = £;[e™^^" + 5«'] ^ 1 

as n — > oo for every m € R. Since for large n, 

= 1 

by the martingale property of the exponential functional if necessary by suitable localization. Thus wc obtain 
the central limit theorem. Roughly speaking, if evaluating the gap — 1 more precisely, wc can obtain the 

asymptotic expansion. In this standard proof in the classical theory of the limit theorems for semimartingalcs 
converging to a process with independent increments, the commutativity of the expectation and £(Mf°)(u)~^, 
where S{M^){u) is the characteristic function of the limit of M", was essential. However, when it is random, 
this method does not work. It explains the difficulty with the asymptotic expansion in the limit with random 
characteristics. 

As already mentioned, the asymptotic expansion is inevitable to form modern theories in the non-ergodic 
statistics, and so it seems natural to try to extend the classical theory of asymptotic expansion in the ergodic 
statistics to a theory that is applicable to the non-ergodic statistics. The aim of this article is to present a new 
martingale expansion to answer this question. 

As a prototype problem, in Section 8, for a diffusion process satisfying the Ito integral equation 

Xt = Xo+ f b{X,)ds+ f a{X,)dws (1) 
Jo Jo 



2 



wc will consider a quadratic form of the increments of X with a strongly predictable kernel: 

n 

Un = ^c(Xi^_J(A,X)2, (2) 

where c is a function, AjX = Xt- ~ Xt _-^ and tj ~ j/n. Under suitable conditions, Un has the in-probability 
hmit 

Uoo = I c{Xs)a{X,fds. (3) 
Jo 

Then the problem is to derive second-order approximation of the distribution of ^„ = ^/n(Un — Uoo)- When 
c = 1, this gives asymptotic expansion of the realized volatility. It turns out that C„ admits a stochastic 
expansion with a double stochastic integral perturbed by higher-order terms. In Section 6, we will present an 
expansion formula for a general perturbed double stochastic integral. When the function a of (1) involves an 
unknown parameter 9 and b{Xt) is unobservable, this gives a semiparametric estimation problem. The error of 
the quasi maximum likelihood estimator On of has a representation by a perturbed double stochastic integral, 
the kernel of which is different from that of the realized volatility. Our result provides asymptotic expansion for 
On though we do not go into this question here. Access Section 6.3, Section 7.1 or Section 8 first if the reader 
wants to know quickly the results in typical problems of a quadratic form, while the results presented in the 
preceding sections are more general. 

The organization of this paper is as follows. In Section 2, we define our object and prepare some notation. 
We introduce the notion of random symbols and define an adjoint operation of random symbols in Section 3. 
The second-order part in the asymptotic expansion consists of two terms and they arc represented by certain 
random symbols. The first one (adaptive symbol) corresponds to the second-order correction term of the classical 
martingale expansion in [28], while the second one (anticipative symbol) is new. Since the characteristics of 
the targeted distribution are random, it is natural to consider symbols with randomness. An error bound of 
the asymptotic expansion will be presented in Section 4. At this stage, the expression of the second-order term 
associated with the anticipative random symbol is not explicit yet. In Section 6, we treat a variable whose 
principal part is given by a sum of double stochastic integrals. It is natural to consider such a variable because 
it appears in the context of the statistical inference for diffusion coefficients and realized volatility. It turns out 
that the anticipative random symbol involves objects from the infinite dimensional calculus. Section 7 gives 
expansion for a simple quadratic form of the increments of a Brownian motion. Studentization procedure is 
also discussed there. The arguments on the nondegeneracy will be applied in Section 8, where we derive the 
asymptotic expansion for a quadratic form of the increments of a diffusion process. Precise approximation to the 
realized volatility in finance is one of applications of our result though our aim is to develop a new methodology 
in the theory of limit theorems. 

2 Functionals 

Let F — {Ft)t(^[o,i\,P) be a stochastic basis with T = T\. On £7, wc will consider a sequence of d- 

dimensional functionals each of which admits the decomposition 

Zn = Mn + Wn^TnXn. 

For every n € N, M" = (Af")tg[g_i] denotes a d-dimensional martingale with respect to F and M„ denotes the 
terminal variable of M", i.e., M„ = M". In the above decomposition, W„, Nn S ^-"($1; M'*)"'^ and (r„)„gN is a 
sequence of positive numbers tending to zero as ri — > cx). 

We will essentially treat a conditional expectation given a certain functional F„ S ^-'(ri; M'^i), n € N. Later 
we will specify those functionals more precisely to validate computations involving conditional expectations. 

We write 

Moo = Mr, Cr = (M")t, Cn = (M")i. 

^The set of d-dimensional measurable mappings. 
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Process M°° will be specified later. Let Coo e Tin;M.'' (g) R'^), Woo & T{n;M.'^) and Foo G T{n;W''^). The 
tangent random vectors are given by 

Cn ~ T-a (^n ~ Coo)^ 
Wn = r-\Wn-Woo), 

Fn = r-\Fn-Foo). 

Consider an extension 

of in,T,P) by a probability space (f), J",P). Let e J"(f2; C([0, 1]; K'^)), Noo € J^(0;R''), CooS J"(n;R'^® 

R''), Woo€ T{n;R'^) and Foc,e TiQ^R'^^). 
We assume ^ 

[Bl] (i) {M'',N„,C„,Wn,Fn) ^''^(•^^ (M°°,iVoo,Coo,W^oo,^'oo). 

(ii) £{Mr\F}^Nd{0,Cn- 

The convergence in (i) is J^-stable convergence. In particular, (C„, W„, Fn) — >^ (Coo, W^oo, -Fqo), the variables 
Coo, Woo and Foo are J"- measurable, and 

(M„, Nn, Cn, Wn, Fn, C„, W„, F„) (M^o, ^oo, Coo, ll'oo , Foo , Coo , W^oo, ^oo). 



Let JF = F W a[M^]. Then there exists a measurable mapping Coo : X M'' ^- M'' (g) R'^ such that 

Coo (C^, Moo) = E[C oo\f] 

and we simply write it as Coo (Moo). The uniqueness of the mapping Coo is not necessary in what follows. In 
the same way, we define M^oo(<^, z), Foo{<^, z) and A^oo(w, z) so that 

VFoo(w,Moo) = F[^oo 1^] 
Foo(w,Moo) = E[Foo\P] 

7Voo(w,Moo) = E[Noo\F]. 

Further, we introduce the notation 

Coo(^) = Coo(t^,2:) := Coo(w, 2 - W^oo) 

and similarly W^oo(w, z), Foo(w, z) and Nood-o, z). 



3 Random symbol 

We will need a notion of random symbols to express the asymptotic expansion formula. 

Given an r-dimensional Wiener space (W, P) over time interval [0, 1], the Cameron-Martin subspace is denoted 
by H . We will assume that the probability space (fi, F, P) admits the structure such that il = il' x W, 
F = F' (E) B(W) and P = P' x P for some probability space {ft' , F' , P'), and consider the partial Malliavin 
calculus based on the shifts in H. See Ikeda and Watanabe [9], Nualart [15] for the Malliavin calculus. D^.p 
denotes the Sobolev space on il with indices ^ € M and p S (l,oo). Let He^oo = <^p>2^e,p- 

Let ^, m e Z+. Denote by C{£, m) the set of functions c : R'' — J' ID'^,oo satisfying the following conditions: 

2[Bl](i)=[Rl](ii), [Bl](n)=[Rl](m) in [31], 
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(i) c € C'"(IR'';ef,oo), that is, for every p>2,c 
derivatives (each element taking values in B 



ID^^p is Frechet differentiable m times in z and all the 
„) up to order m are continuous. 

(ii) For every p > 2, 

\\d^c{z)\\e^p < Ce,p{l + Izlf''" (z e e Z^with < m) 

for some constant C't^p depending on £ and p. 

Note that if c = c(z) does not depend on z, then this condition is reduced to that |lc||^.p < oo. The sum of the 
elements of a G Z'[, i.e., the length of a, is denoted by \a\. 

Let m, n e Z+. A function <; : Q x R''- x {i R'*) x {i R^^) — > C is called a random symbol. We say that a 
random symbol <; is of class (£, m, n) if <; admits a representation 



(;{z,iu,iv) — ^ Cj(z)(m)™^ (iw)"J (finite sum) 



(4) 



for some Cj G C{£,\mj\), rrij G Z'^ {\mj\ < m) and nj € {\nj\ < n). We denote by S{£,m,n) the set of 
random symbols of class {£, m, n) . 

The Malliavin covariance matrix of a multi-dimensional functional F is denoted hy ap, and we write Ap = 
det ap- Suppose that £ > £o :^ 2{[di/2] + 1 + [(n + l)/2])'^ and the following conditions are satisfied: 

(i) Foo e Df+i,oo(K'^0, Woe e D^,oo(K'^) and Coo e Df,oo(K'^ K'^); 

(ii) A^i, detC^i enp>2LP; 

(iii) e S{£,m,n). 

For the random symbol G S{£,m,n) taking the form of (4), we define the adjoint operator <;* of as follows. 
It applies to (/)(z; Woo, Coo)Sx{Foo) as 



^(z, d,, a,)*{0(z; Woo, Coo)Sx{Foo)] = ^(-9.)™^ {-d^T^ {c,{z)cl>{z; Woo,Coo)SAFoo)) ■ 



(5) 



Here 0(z; /i, C) is the normal density with mean vector /i and covariance matrix C, and the derivatives are 
interpreted as the Frechet derivatives in the space of the generalized Wiener functionals of Watanabe ([26], [9]). 
By assumptions, (-9z)™'0(z; W^oo, Coo) G ©£,00 and (-dx)"' S^iFoo) = (9"^4)(i^oo) € B.^^oo- denotes the 
density of Foo- The generalized expectation of the formula (5) gives a formula with the usual expectation: 

E[<;{z,d,,dxy[(b{z;Woo,Coo)ScciFoo)} 
= Y.^~d,^"'^{-dxr^E\cj{z)^{z;Woo,Coo)Sx{Foo) 



Y.{~d,T'i-d.r'[E[cj{z)(b{z;Woo,Coo)\Foo=x]p^-ix) 



E 



^{z,d:,,dx)*{ (t>{z;W 00, Coo) 



p''-{x) 



For m' e Z% and n' e Z'ji , 



sup 



z" a;" E 



(-d,yc,{z)-{~dj' 



< 



sup||(-9,)''c,(z)||,,p II z™ i-dj 



■,Woo,Coo){-d.xr'Sx{Foo) 



{z;Woo,Coo)hp, \\FUi,P. \\i~d,rS,{Foo)\Up, 



< sup{(l + |z|)'='*''' • (1 + Izl)-^''" • 1} 

Z,X 

< 00, 



(6) 



'The number £q = 2[(n + di + 2)/2] is possible to use for this io if we regard d"i Sx as a Schwartz distribution. 
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where p,pi,p2,P3 > 1 with p ^ + Pi^ + P2^ + Pz^ = ^- Consequently, we can apply the Fourier transform to 
obtain 



E 



{u,v) 



'^{z,d,,d^r\(t>iz;Woo,Coo)SAFoo) 



E 



exp(m ■ z + iv ■ x)E 



exp(m • z + iFoo[v\)4>{z; Woo,Coo)'^{zTiu,iv)dz 



dzdx 



(7) 



More generally, duality argument also yields 



(u, v) = 



<;{z, iu, iv)(l){z; Woo, Coo)e* 



(u). 



4 Asymptotic expansion formula 

Nondegeneracy of the targeted distribution is indispensable for asymptotic expansion. However, the complete 
nondegeneracy, that implies absolute continuity, is not necessary, nor can we assume in statistical inference. For 
example, the maximum likelihood estimator does not admit a density in general; even existence of itself is not 
ensured on the whole probability space. Besides, the complete nondegeneracy is often hard to prove although 
it would be possible, and this restricts applications of the result. On the other hand, partial nondegeneracy is 
easier to work with. There the localization method plays an essential role. The localization is realized through 
a sequence of J-"- measurable truncation functionals In applications, we construct a suitable ^„ to validate 
necessary nondegeneracy of the functional in question. 
We will assume the following conditions.'* 

[B2]e (i) Foo e Df+i,oo(M'^0, Woo e Df+i,^(K'^) and Coo € Df,oo(K'' ® K''). 

(ii) M„ e D^+i,oo(K'^), Fn e Bf+i,oo(M'*0, Wn e D^+i,oo(M'^), Cn e D^,oo(IR'* ^K"*), Nn e D|+i,oo(K'*) 

and ^„ G D£_oo(]R)- Moreover, 



sup ||M„|| e+i,p + II Cn \\e,p - 



Wn \\e+l,p + II Fn |U+l,p + ||A^n|U+l,p + ||6JU,p} 



< oo 



for every p > 2. 

[B3] (i) lim™P[|en| < I] - 1- 

(ii) |C„ — Cool > r^""^ implies |^„| > 1, where a G (0, 1/3) is a constant. 

(iii) For every p> 2, 



limsupi; l{\u\<i}^iAi„+w^,F^) 



< oo 



and moreover detC^^-^ € r\p>2LP. 
We have A^^ e r\p>2L^ by Fisher's inequality and Fatou's lemma. 

We will give an asymptotic expansion formula to approximate the joint distribution of {Z„,Fn). Let 



a{z,iu,iv) = -CocizY' 'iiuj){iuk) + Woo{zy {iuj) 
+Noo{zy{iUj) + Foo{zy{ivi) 



(8) 



'[B2]f (i),(ii) are [S]£,m,n(i),(ii) of [31], respectively. [B3](i),(ii),(iii) are [S]f ,m,„(iii),(iv),(v) of [31], respectively. 
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for ueM.'^ andvG M.'^^ 

The symbol (8) is tlie adaptive random random symbol, which corresponds to the second-order correction 
term of the asymptotic expansion in the normal limit ([28]). fn the mixed normal limit case, we need an 
additional one referred to as the anticipative random symbol and denoted by 'a{z,iu,iv). As will be seen in 
applications in this paper, the anticipative random symbol is given by the Malliavin derivatives, which shows 
non-classical nature of the present asymptotic expansion beyond the standard invariance principle. 

We shall define the anticipative random symbol. Let 

*oo(w,w) = expjiVKooM - ^Coo[u®^] +ii^ocM 
Moreover, set L"{u) — e"{u) — 1 with 

e?M = e.p(.M,H + ic;.|»-: 

We write ^" = i^l^l^", "Q^^ = i'^'^^^d^^ = i'^^^^d^^ and ^" = ^S^^^Jf^ for the multi-index a = (ai,a2) e 
Z^, d = d + di. Let V € C°°(M; [0, 1]) such that ip{x) = 1 if \x\ < 1/2 and ?A(x) = if |a;| > 1 and let V'n = V'(60 
for n S N. Furthermore, let 

If Tpn is equal to one, in fact it is usually so without large deviation probability, and Woo, C'oo and Foo are 
constants, as this is the case in the normal limit case, then = since L"(m) becomes a mean zero martingale. 
However does not vanish in general. We may intuitively say that measures the torsion of martingales 
under the shift of measure P by 'I'oo(w,t;). The effect of this torsion appears quite differently, depending on 
the cases. Thus, we will treat the effect in a slightly abstract shape for a while. The adaptive random symbol 
describes it as (ii) of the following condition. ^ Let £^ = 2[(ii/2] + 4. 

[B4]e,m.n (i) £€5(4,2,1). ^ 

(ii) There exists a random symbol W e S{£, m, n) admitting a representation 

a[iu,iv) — '^^Cj{iuY^^ [iv)^^ (finite sum) 

i 

for some random variables Cj and satisfying 



lim r-i<i>2^"(u,«) = ^"E 

n^oo 

^ WE 



/ exp {iu - z + iFa2[v\)(j){z\ Woo, Coo)dz a{iu,iv) 
exp UWooN - ^Coo[m®^] +ii^ooH j a{iu,iv) 



(9) 



for ueR'',ve K'^i and a = (ai,Q!2) € Z^. 

Set ^^■''{u,v) = lim„^oor-i$^'"(M,v). 
Remark 1. It is also possible to consider a more general random symbol a{z,x,iu,iv). 

Remark 2. As mentioned above, vanishes in the classical case of deterministic ^oo(u,w) thanks to the 
local martingale property of L'^{u). Non- vanishing case will appear later. 



^Einstein's rule for repeated indices. 
'^[B4]f,n,,„(i),(ii) are [S],,„,„{vi),(vii) of [31]. 



''The number it = 2[(di + 3)/2] is possible as the previous footnote. 
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The full random symbol for the second-order terms is 



a := a + a. 



(10) 



In order to approximate the joint local density of (Z„, Fn), we use the density function 



Pn{z,x) 



E 



Fqq X 



(x) 



Note that Pn{z, x) is well defined under [B2]f , [B3] and [B4]f^m^n when £ > £q. We should remark that Pn{z, x) is 
written in terms of the conditional expectation given F^o ■ This suggests that conditioning by f oo or equivalently 
by Fn under truncation is essentially used in validation of the formula. With Watanabe's delta functional, we 
can write 



Pn{z,x) = E 



{z]Wo.,C^)5^{F^) 



cj{z,d,,d^y{ (/)(2;W^oo,Coo)4(Foo) 



+rnE 



For M, 7 > 0, let £(Af, 7) denote the set of measurable functions / : 
\z\ + \x\)"i. Let 



(11) 



satisfying \ f{z,x)\ < A/(l + 



A„(/) = 



E[f{Zn,Fn)\ - i }{z,x)pn{z,x) dzdx 



Let AO(d,g) = {u e M''; \u\ < r-^}, where q (1 -a)/2 e (1/3,1/2). Let 



e{k, n) 



r-i$2'"(w,u) - ^'^''^{u,v)\dudv. 



a:\a\<k (27r)'' J Al(d.,q) 

The following theorem gives an extension of Theorem 4 of [28]. 

Theorem 1. Let t = IqV (d + 3). Suppose that [Bl], [B2]f, [B3] and [B4]f_n,^n are fulfilled. Let Af,7 e (0,oo) 
and 6 e (0, 1) he arbitrary numbers. Then 

(a) there exist constants Ci = C{M,j,9) and C2 = C{M,j) such that 



sup A„(/) < CiP 

/e£(M,7) 



ien|>:rl +C2ei["f + d] + l,n) + o{rn) 



as n 00. 



(b) // 



sup sup r-i|(M,i>)|'^+i-^|$2;"(u,«)| <oo 



(12) 



for every a G and some e — e{a) G (0, 1), then for some constant Ci — C{M, 7, ( 



sup A„(/) < CiP |^„| > - +o(r„) 

/G£(M,7) L 



as 71 CXI. 



(13) 



In Theorem 1, m is some number, which puts restriction when (12) is verified. Next, we shall present a 
version of Theorem 1. Let s„ be a positive random variable on fl. 
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[B2']i (i) i^oo € ]D)f+i,oo(IR'^0, Woo e Df+i,^(M'') and Coo € ]D)f,oo(IR'^ «> K''). 

(ii) M„ e ©f+i,oo(IR''), e Df+i^oo(M'*0, e Df+i^oo(K'*), C„ e Df,oo(K'* ® K"^), 7V„ e D^+i,oo(K'^) 
and s„ e Df_oo(IK-). Moreover, 

{o o o ^ 

||^n|U+l,p + II Cn \\e,p + II Wn \\i+l,p + \\ Fn \\e+l,p + \\Nn\\e+l,p + \\Sn\\£,p > < OO 

for every p > 2. 

[B3'] (i) P [^{M„+Wa^,F^) < Sn] = 0(r,\+'') as n ^ oo for some k > 0. 
(ii) For every p> 2, 

lim sup i? [s^''] < OO 

and moreover detC^-^ £ r\p>2LP. 



Theorem 2. Let £ = £o y {d + 3). Suppose that [Bl], [B2']i, [B3'] and [B4]^?,m,„ are fulfilled. Then for any 

M,-fe (0,c»), 

(a) there exists a constant C such that 

sup A„(/) < Ce([7 + rf] + l,n) + o(r„) 
/e^(M,7) 

as 71 —> OO. 

(b) If {12 ) is satisfied, then 

as n ^ OO. 



sup A„(/) = o(r„) 
/e£(M,7) 



The above results can apply to the expansion of the distribution of functions of (Z„,i<"„), in particular, 
Zn/Fn and Zn/VK. 



5 Proof of Theorems 1 and 2 

5.1 Decomposition of the joint characteristic function 

Let Zn = {Zn,Fn). Then according to the notation of the multi-index, Z^ — Z^^F^'^ for a — (ai,a2) £ 
Z'l X Z'l' =Z'l,d = d + di. Let 

g^{u,v) = ^[^„Z°exp(«Z„M+zf^„H)] 
for u e M'' and v £ M'^i . We denote 

g-{z,x) ^ f e-^--^--g:{u,v)dudv 

if the integral on the right-hand side exists. 
Let 

e (x) = / e^'^ds, 
Jo 
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then = 1 + X e (x). For 



we have 



Then we have 



Set 



Then 



*„(u,w) = exp <{ iWn[u] - -C„[u®2] + ip^^y^ 



e„(u,w) = log (*„(u,w)5'oo(w, w) ^)+ir„iV„[u] 

= -i(C„-Coo)[u®2]+i(K[„]_F„oM) 
+i{Wn[u] - Woo[u]) + irnNn[u]. 

g"iu,v) = ^"£;[^'oo(u,w)V'«] e^(u)^'oo(u,w)e«(u,w) e (e„(u,w))i/'„ 
+ri^[L'/(«)vI/^(u,«)V'„] 

v) = exp ( ^M,"M + icHw®']) exp (zM^ooN " ^^^oo[m®'] + zi^ooH 

1 

2' 



exp {iM^u]) exp (zW^ooM + *^^ooM) exp ( ^{C^ - C^)[u^^'_ 



Condition [B3] (ii) imphes 



\Bnu,v)\ = exp -(Cr-Cr)[w^^] exp -(C„-Coo)[' 



,®2- 



< exp( -ri-'^l^.p 



and 



whenever ■(/'„> 0. 

We shall consider the second-order term of type I. 

Lemma 1. Suppose that [Bl] and [B2]i for some £ > and [_B3] (i), (ii) ^ are fulfilled. Then the limit 

^ lim r-^<^];'^{u,v) 

exists and takes the form 

^^'"{u^v) = ^"e\( exp(m-z + ii^ooH) 

•(-^Coo(z)K'] + z + 1 iVoo(z)M + i Foo(^)h) '/'(^; w^oo, c„,) 

/or every a G . 



*It sufRces to assume [i?l] and [i?2] of [31] . 
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Proof. Since the family of functions u i— >■ B'^{u, v)ipn {n € N) is uniformly (in n) locally (in u) bounded due to 
(15), we have, by using the weak convergence condition and (16), 

l>i>"(w,w) = lim r~i$i^"(u,w) 



lim r„ 

71— >-00 



exp {iM^[u]) exp (iVFooN + iF^[v])en{u, v) exp [ -{Cn - Coo)[u®^] ) e (e„(M, u))-0„ 



= lim 



r I exp {iM^[u]) exp (zM^„oM + iF^[v])r-hn{u,v)^ exp Q(C„ - Coo)[u®']) e (e„(M, ^;))V'n 
= ^"E; exp(^iAfi°°[u] + iWoo[u] + iFoo[v]j 

The last expression is equal to 



rE 



exp 



exp (iA/ooN + «VF"ooM + ii^ooH) 



rE 



Coo{Moo)[u®^] + i M^oo(Afoo)M + i iVoo(Afoo)M + ^ Foo{Mo^)[v] 



exp (iu • 2; + i Woo M + jFoo [v] ) 



-ic'oo(^)[u^'] + i Woc{z)[u] + I Noo{z)[u] + I Foo(z)H) <^(z; 0, Coo) dz 



= WE 



exp (iu • z + iFoo [w]) 



-\Co.{z)[u®^] + I Woo(^)M + I ^oo(2)M + I F^{z){v\ ) 0(z; Woo, Coo) 



by J^-conditional expectation, which is what we desired. 



□ 



In particular, 
Under [B4]f^ 

m,n (i), the conditions just before (5) are satisfied for — ct, and 
•^K.)[^''°](^'2;) = ia.^a,, (i?[Coo(z)^'^V(^;W^oo,Coo)|Foo =a:])p^~(x) 
-d,^ (i;[Woo(z)^0(z; Woo,Coo)|i^oo = 2;]) p^-(x) 
-d,^ [e\NUz)^{z-W^,C^)\F^^x^V^^{x) 



-d^, (^E[F^izUiz;Wo,,Coo)\Fo^=x]p^-ix) 



E 



g_{z,dz,dx)* < 0(2; Woo, Coo) 



p^°^ (x) 



(17) 



We can say that the random symbol a corresponds to the case where the martingale central limit theorem 
occurs without conditioning. On the other hand, we need another random symbol which reflects the deviation 
of the martingale in question from a real martingale under conditioning. The Fourier inversion J^^J'^^ [$^''^] has 
a random symbol a{dz, dx) in that 



tT(9.,9.)* 0(z;Woo,Coo) 



F(yQ — X 
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See (7) and (9) for this equality. 



5.2 Estimates of error bounds 

We shall investigate the approximation error of p„(z, x) to the joint local density of F„). The error bounds 
depend on the smoothness of the distribution £{{Zn, Fn)}, and the arguments will require a tool to evaluate it 
quantitatively. The conditions are written in terms of the Malliavin calculus since it is convenience in practical 
uses while more primitive expression of them would be possible without it if we would admit more cumbersome 
descriptions. 
Let 



and let 



E 



■ip„4>{z;Woo,Coo) 



Fr^ X 



(x) 



-TnE 



p^-ix) 



K{z,x) = {z,x)°'h\^{z,x) 



Lemma 2. Let £ > 2. Suppose that [B2]i and [B3] are fulfilled. Then 

sup sup sup r-^\{u,v)f''^\'^l,'°'{u,v)\ <oo. 

Moreover, 

sup sup z;)|^"^|l>^^"(u,-y)| < cx). 



^"E 



Proof. By definition, 



= E 

'P2,l,a [^-i ^7 '^nj M^,Woo,Foo,N„,Cn,Wn.Fn j^: 

where P2A,a is a smooth function such that 

\p2,iA^,v;x)\ < Cail + \u\^ + \v\){l + {ueW\veW'\xeR'''+*''+^'''+^ 



exp \^i{M^ + WooM + iFoo[v] 
r~'^en{u,v)exp Ql^n - Coo)[u®^]^ e (e„(u, u))V'n 
exp ( i(Mi" + WooM + iFoo[v] 



(18) 



for some constant C'a, and moreover the derivative of P2,i,q of any order admits the same type estimate. It 
should be noted that in the expectation on the right-hand side of (18), we do not need an exponential like factor 
in P2,i,ai due to the truncation by ■(/'„. 

We will apply the integration-by-parts formula £-times for the pull-back of the function f{z,x) = e™-^+«'"-^ 
by taking the advantage of the uniform nondegeneracy of the functional (Af„ + W^o, Fao) under tp^. Then, by 
truncation by tp^ and the restriction of the region of (u, v), the functional in the expectation of (18) is essentially 
quadratic in u and linear in v. It should be noted that all variables related to u or v are differentiated at the 
same time when applying the IBP-formula, therefore the index of differentiability should be common. 

The second inequality follows from the first one if one takes the limit in n. □ 
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Define the d x d random matrix i?^ by 

< = <yQl{rn{DQn,DR^}+r„{DR„,DQn}+rl{DRr,,DRn)), 

where Q„ = (M„ + W^,F^) and i?„ = (^f „ +N„,, Fn)- Obviously 

^(z„,j^„) = '^QAId + K)- (19) 

Let = ''n^l^nP- We redefine ipn by 

V'n = i^iinMO- (20) 

^n" (j = I7 2), g° and h" will be defined for V'n given in (20). The following is an extension of the expansion 
of the local density in the normal limit case; see Theorems 3 and 5 of [28]. 

Lemma 3. Let i — £q y (d + 3) . Suppose that [Bl], [B2]i, [_B3] and [B4:]i^m,n o-i"e satisfied. Then for every 
k e Z+, 

sup \\iz,xt{g^Jz,x)-hl{z,x))\<e{k,n) + o{r^). (21) 
Furthermore, if (12) is satisfied for every a G Z"! and some e ~ e{a) G (0,1), then e{k,n) — o(r„) for every 

kez+. 

Proof. By definition, 

Moreover, we have (14) for 5^(w, v). Applying the IBP formula ^-times under truncation by ipn to the definition 
of we see that for every a G Z^j., there exist C > and n* G N such that 

\g^iu,v)\ < C{l + \u\ + \v\)-' (22) 

for all {u,v) G M.'^ and n> n*. In what follows, we will consider only sufficiently large n. Therefore the local 
densities g^iz, x) are well defined. On the other hand, one can verify the integrability of $^'"(u, v) by using the 
nondegeneracy of Coo, the nondegeneracy of the Malliavin covariance of F^o in [B3] and the representation (9). 
[The aftereffect by the integration- by-parts for Foo is absorbed by the nondegeneracy of Coo ■] The integrability 
of $^'"(u,w) and ^^'"(u,?;) has been obtained in Lemma 2 . The decomposition (14) implies that is 
integrable for each n. Thus, the decomposition and the estimate of the following inequality based on the Fourier 
inversion formula are valid: 



sup \g"{z,x)- h'^{z,x)\ = sup — i-^ 



'i9niu,v) - h^{u,v))dudv 



< I {\gZ{u,v)\ + \K{u,v)\)dudv 



1 



(27r)'' JA°(,d,q) 

1 



\r-^<i>l^°'iu,v) - <^^-°'{u,v)\dudv 
\r-^^^^°'{u,v) - ^^'°'{u,v)\dudv. (23) 



We remark that $2," ^ j^"|>2,o ^^.^^^ (9) ^s = ^"$1'° mentioned at (17). 

By (22), 

\9^{u,v)\dudv = Oirf-^^) ^ Oirl'^) ^ oir^) 
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since 3q > 1 due to a < 1/3. 

As suggested above, we use the Gaussianity in u and the IBP formula in v to obtain 



'\A'i{d,q) 



v)\dudv 



< 



jR<i\AO 


{d,q) 






+rn / 




(d.q) 


^dudv 


+rn / 




{l + \u\)-^\v 

(d.q) 


-{(n+rfi + l)}+n^^^^ 




+ 


>„) = o(r„), 





where A; > (i+ 1 is an arbitrary number. The second term on the right-hand side of (23) is estimated by Lemma 
2. 

In order to conclude the second assertion of the lemma, to the third term on the right-hand side of (23), 
obviously, we apply (12) and the inequality which is obtained by its limit as ti — )■ oo. □ 

Proof of Theorem 1. Let / G £{AI,j). By the estimate (22), we know that the local density 5" exists. In 
fact (7^ is a continuous version of {E[tpn\Zn = {z, x)]dP^^'^} /dzdx, it has moments of any order and 



E[f{Zn)iP„ 



J{z,x)gl{z,x)dzdx. 



In particular, the integrability of f{z,x)g'^{z,x) is obvious. We have 

\E[f{Zn)]-E[f[Zn)M\ < ll./(^")llLp'l|l-^n|U'' 

for any dual pair of positive numbers {p,p') with l/p+ 1/p' = 1. The integrability of f{z,x)h'^{z,x) is known 
from (6) in Section 3 or in particular from Lemma 3, and also we have 



< 



f{z,x)g^{z,x)dzdx— / f{z,x)h'^{z,x)dzdx\ 
\f{z,x)\{l + \{z,x)\^)-''^'dzdx ■ sup 1(1 + \{z,x)\^)''/^g^,{z,x) - hl{z,x))\ 



for any k > j + d. Apply a similar estimate as in (6) for Cj = 1 — Tpn and p€ (1, 1/0) to obtain 

dzdx 



fiz, x)E^il - ^„)</.(z; W^oo, Coo)4(Foo) 

< C||l - V'nilf.p, 

which serves to replace p„ by /i^. Furthermore 



16.1 > 



1 



p 



\a > 



for 9 < 1/p. Here in order to obtain > 2 ^] — o(rfj) for any A: > 0, we can apply the truncation by ^„ for 

nondegeneracy of ctq^ . After all, we obtain the desired result by Lemma 3. □ 

Proof of Theorem 2. It holds that P [r:^''\Cn - Coo \ > 1] = 0(r,\+'"') for any constant c G (2/3, 1) and any 

o 

k' > 0, due to the boundedness of {Cn} in L°°^— Hp^iLP. We take constants a and c so that 2/3 < 1—a < c < 1. 
Let 



lO-i7-2qc„-Coor + 2 



1 + 4:^(M„+W^,F^)Sn^ 
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We only consider sufEciently large n. Then [B2]i and [B3] are verified under [B2']g and [B3'].We take a sufficiently 
large 9 G (0, 1) depending on k A k', and apply Theorem 1. Note that 

□ 



6 Expansion for the double stochastic integral 
6.1 Kernel of the quadratic variation 

Hereafter, let £ = c? + 8. In order to fix ideas, we will consider the kernel function K"'{s, r) defined by 

j 

for ii:" e Bi+i^ao{H (8) E'*) and e Bi>+i^^{H (g) M'' M"*), where stands for the tensor product with 
partial Hadamard product given the index (i, a) G {1, d} x {1, r}. Here H is identified with L^([0, 1]; M''), 
and the partial Hadamard product (entrywise product) given an index A G A is defined as follows: for a = 

iaxj)xeA,jeJ € M"^ M-^ and b = {bxk)xeA,keic G R"^ M'^, a 6 G R'^ R-^ K'^ is given by 

a0 6 = {a\jb\k)\eAjeJMeic- 

When J' and K, are one-point sets, is a usual Hadamard product 0. The sequence {ij}j=o,i,... J" € N) is 
a triangular array of numbers such that tj = t" depending on n, = < < • • • < tj" = Ij rnaxj \Ij \ = o(r„) 
and the sequence of measures 

^^''-r-'J2\I,\'St^_, ^ n (25) 
j 

weakly for some measure /i on [0, 1] with a bounded derivative, where Ij = (tj^i,tj]. Suppose that K"^ and K" 
are progressively measurable. More strongly, we assume the strong predictability condition that K"(s) is 
-^tj_i -measurable for s G {tj^i,tj]. ^ We write 

K"(s,r) = if"(s)0 7^"(r). 

Corresponding to the representation (24) , we consider M" given by 

Ml' = r-^Y. ^"(s)0(/ k'\r)dwr)dws, 

where w is the canonical process on W, extended naturally to Jl. 
In this case, 

Cn = Tr° / r-2V^(s)(i^"(s)0 / K^{r)dwr) ds 
Jo J ^ Jtj^i ' 

and it will turn out that the in-p limit is 

Coo = iTr*^'if°°(t,i)®V(rfi), (26) 

where Tr° and Tr* denote the traces of the element of L(R''; R'') and L(M'' M'; R'' R''), respectively. 

Let A = {(.s,r); < r < s < 1}. Let A" = Uj{(s,r); tj-x <r <s < tj}. Let <5„ = r-^T,j I^P = ^(1) as 
assumption. 

^Obviously this condition is satisfied if one replaces K^{s) by K^{tj — i) in the representation of the kernel function K^{s,t). 
In examples, it will turn out that this replacement does not cause any practical difficulty. 
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Lemma 4. Suppose that K" satisfy the following conditions. ^'^ 

(i) sup„gp,sup(^ ,,)g^„ \\K"{s,r)\\p < oo for every p > 1. 

(ii) For every p > 1, 

sup sup ||if"(s,r)-i^"(tj_i,i,_i)||, 

j (s,r)eA", sG/j 



as n ^ OO. 



(iii) There is a continuous process K°°{t,t) such that 



supsvLp\\K'\tj-i,tj_i) - K^{t,t)\\i ^ 
3 te/j 



as n ^ oo. 



Then (26) holds true. 

Proof. Condition (ii) together with the convergence of /i" ensures 



Cn = Tr" / r-^y^li^{s)[K^{s)(Z) K^{r)dwr] ds 

JO : ^ Jt,-l ' 



3 



where 



Cn = Tr° / Vl/,(s)(i^"(t,-i)0 / k^{t,^{)dwrY\s 
Jo J ^ Jt,-i ' 

and Op{br() denotes a sequence of matrices of indicated order. We see 

= ''n'ETr°Tr*|i?"(ij-i,ij-i)®'^ r {(T dwrY^ - r l,dr\ ds\ 
+r-2^Tr°Tr*|i^"(t,„i,t,_i)®2,^ f l.dr ds\ . 

The square of norm of the first term on the right-hand side is of the order 



3 



(27) 



as n cx). The second term converges in probabihty to the right-hand side of (26) by the L^-equi-continuity 
of the random kernels. □ 

o 

Remark 3. It may seem that we can specify the behavior of Cm however it is still related to the Ito expansion 
of the process if"(s), so we have left this procedure to each individual case. Later we will consider the situation 
where K'^{s) = K'^{tj^i) for s £ {tj^i,tj]. It is an easily tractable case in the above sense. We will do with it 
there. 

Let I, = -^(Cf - Ci°°), with being the limit of C^. 



^'^Cloarly, in order to show the result, the assumption is much stronger than necessary. 
'^^The reader may use for K°°{t, t) while we prefer the latter notation. 
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[Al] (i) G D£+i(_ff (E) H (E) W^) and a representation density of each derivative admits 

Dr,,...,r,K^{s,r) 



ess. sup 

ri,...,rfc,e(0,l), 
(s,r)eA", new 



< oo 



for every p G (1, oo) and k < £ + 1. 
(ii) For every 77 > and p G (1, 00), 



sup 

se(Oa),eGS''-i 



I.Je« 



(1-3)1+" 



< 00. 



(iii) sup,e[o,il,neN - Cr I < rl'^ whenever |C„| < 1. 

(iv) For every p > I, 



sup sup ||if"(s,r)-i^"(t,_i,t,_i)|l,,p = 0(r29) 



J (a,r.)eA" 



and 



as n — cx). 



supsup||i^"(i,_i,t,_i)-i^°°(t,0|U,p = 0(r2?) 



Remark 4. (i) We note that 2(7 = 1 — a G (|, 1) for (iii); in typical cases, = n~' > n~2 . It is essentially 
possible to remove (iii) by redefining as it will be done under another set of conditions later. However, we 
here keep (iii) because it shows a role of ^„ and making such ^„ in each case is rather routine. 



(ii) Under [Al] (i), for every p G (l,oo) and k < £, 



ess. sup 

ri,...,rfc,se(0,l) 



\D. 



ri,...,rfcJi-s| 



1 - S 



< 00. 



(iii) As for [Al] (ii), in order to do with exp(i(C^ — C^)[u®^])) for s near 1, we use the nondegeneracy of the 
derivative of in s, or a large deviation argument. 

(iv) The nondegeneracy detC^^ G r\p>2LP follows from [Al] (ii). Indeed, it implies 

sup P[Coo[e®^] <e] < ef sup WMe'^TX ^ ^p'" > 

for some constant Cp for every p > 1. Then the desired inequality is obtained; see e.g. Lemma 2.3.1 of 
Nualart [15]. 

We assume: 

[A2]^ (i) Foo G ©£+1,00 (M'*!) and Woe. G D^+i,oo(K'') ■ 

(ii) F„ G lD)^+i,oo(M'^0, Wn G B£+i,oc(R'^), Nn G Df+i,oo(K'^) and C„ G Be^ooi^). Moreover, 

{000 ^ 
II Cn \\e,p+\\ Wn \\e+l.p + II Fn \\e+l,p + ||^^n||£+l,p + ll^nlkp \ 



sup ■ 

neN 



< 00 



for every p > 2. 

(iii) CTG 5(4,2,1). 

(iv) {M",Nn,Cn,Wn,Fn)^'^^^^'> {M^ , N , C oo ,W oo , F oo) ■ 



17 



(v) ForG = M^oo andfoo, 

ess. sup |l£'ri,...,rfcG||p < OO 

ri,...,rfcG(0,l) 

for every p S [2, oo) and k < £ + 1. Moreover, r i— ?> DrG and (r, s) Dr.sG (r < s) are continuous 
a.s. 

Remark 5. Under the assumptions, a € S{i,m,n) and J-^^-^[^'^'^]{z,x) will have the random symbol ct, and 

£{A/(°°|J^} = Nd{0,C^). [A2]^ (iv) is a condition for the joint convergence since we have not specified the 
random variables other than M". We set (iii) by a similar reason. 

The nondegeneracy of (M" + Woo,Foo) will be necessary. 

[A3]'' (i) There exists a sequence (i„)„eN in [0, 1] with sup„ t„ < 1 such that the family {(M"+Woo, i^oo)}t>t„,neN 
is uniformly nondegenerate under the truncation by namely, 

sup E[lii^^i<iy{dct a(^M^ + w^,F^)) < OO 

for every p > 1, 

(ii) lim„^oo/'[|C«l < 5] = 1- 



Remark 6. We removed the condition "|C„ — Coo\ > implies > 1, where a £ (0, 1/3) is a constant" 
because we can modify the definition of to satisfy this condition. It is possible thanks to LP-boundedness of 

o 

Cn- As for tn, typically i„ = 1/2. 

6.2 Anticipative random symbol and estimates of Fourier transforms 

We are working with [Al], [A2]^ and [A3]l We denote yl^(s) = l(t^._^,t^.] (s)i(:"(s) and B]'(s,r) = l{t,_^<r<s<t,}K'^ 

Let Aj — A=i,...,d and = i^Ja 13) ■ a-th entry of the density function DtF taking values 

in R'' will be denoted by d\"''^ F. We apply the IBP formula to obtain 

E[L^^{u)^Un,v)i,n] = r-^Y.^E[D*ie{u)A']{-)QD*B';{-))[u]^^{u,v)^n 

j 

= r-i^zi? /(e"(«)A^"(.)0i?*i37(-))M,i?(^oo(",«)V'«) 
3 

= <'T.T. t E\u'e:{u)Al'^{s)D*Bl'^^Xs)Di"H^^iu,vM 

'■«'EE f E\u^{Bll{s,-),D{e-MAl^{s)D^t^ ^{u,v)^r.)]) 



ds 



3 A,a,/3 



ds 



E 



dsdr. 



Since is strongly predictable. 



E[UI{u)'^^{u,v)i}^ 



E 



dsdr. 
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or more generally 

r^[i'i(")*oo(w,t')V'„] 



E 



ao+ai=a 



E 



^0 



dsdr 



with sonie constants Cq^.q^ appearing in Leibniz's rule for We will find a representation of the random 
symbol a associated to J^^^-^[^-^'°]{z,x) and verify the convergence (9). 
The density function appearing here is 

Dr[e':{u)D, (^'oo(u,w)V„)} 

= Dr[e':{u)D, (^exp l^tW^[u] - ^C^[u'^^] + tF^[v]j } 

+e:iu)-9oo{u,v)iM{iDrW^[u] - ^DrC^[u^^] + iD,F^[v]^ ® {iD,W^[u] - ^D,C^[u'^^] + iD,F^[v]^ 

+ Dr\^ e'; (wj^-oo (U, V'n } ■ 

Moreover, the Leibniz type formulas for ^"2r', |e"(u)r's (4'oo(u, v)-0„) | remain in force if one applies the 
Leibniz rule to each term on the right-hand side of the above equality. It will be observed that the function 
l^l^E [L"(u)^'oo(u, w)V'n] I is dominated by a polynomial in at most fifth-order under a restricted range of 

{u, v) by means of the truncation with ipn- 

We introduce an W (E) IR''-valued random symbol 



®2i 



iDsFac[v] 



6.2.1 The terms involving DrM^ 
We have 



3 



As 

tj-iAs 
tj As 

tj-iAs 



DrK^{si)0 / K'^is2)dws, dws 



i^"(si) / DrK^{s2)dw,, dw. 



i^"(si)0l(t,_,,.,](r)i^"(r)d«;. 



/t,- A; 
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With this representation, we see 

r-l /-l 



^0 



E / ' DrK'-'is,) &( r k^{s2)dws, ) dw. 



ft-, As / fsi 



+r-'Y^ / k-{s^)l^,^,_^,,,]{r)rz,K-{r)dws, 



Thus we have 

K''{s,r)(E)DrMyr 



= r-^Y.ht,-^^t,]{s)k^{s)^r-^ f ( r""' ^"(r)0M"(si)0 ( / 



(si) ( / k''{s2)dwsA dWs, 



+i^"(r)0 / /C"(si)0 / DrK"{s2)dws, ] dw, 

ntj As 

+X"(r) / ^t,^,^,,^{r)k'\r)dws. 



si 



Here we note that for terms not to vanish, it is necessary that 

r < si < tj, for Drk'^isi) ^ (28) 

r <S2< si < ty for Drk"{s2) ^ (29) 

tj-i <r <s (30) 

ij-i <s<tj (31) 

tjv_i < s (32) 

In particular, tj-i < tj' from [(28) or (29)] and (30), and tj'-i < tj from (31) and (32), so that j' = j. Similar 
argument is valid for the last two terms to neglect off-diagonal elements for j ^ j' . 
We will assume that 

^n'El^^l' ^ (33) 

3 

as n — )■ oo. Then, applying Jensen's inequality, we have 

r^n^ ■■^r-^Y.\^A^ =0{rn) (34) 
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and 



(2) — fl") 

moreover, r„ < 0{rnrn ') since maxj \Ij \ = 0(r„) by assumption. 
Let 

Without scaling by r~^, 
T — 



-Tt*E 



E^(^K''{s,r)[u],el\u)^ooiu,v)yjniDrM^[u]®Q, 

•^0 



dsdr 



tj-l As 



-Tr* / E 



As 



if"(s,r) 



-Tr*£; 



,®2l 



o(r«), 



where 



J 

-file's 



(^j - si)(si - tj-i)dws 



tj-i 



tj-i 



(35) 



(36) 



The last equality in the expression of I„ is by straightforward L^-estimate with triangular inequality and L^- 
continuity of the process Qs', note that Qs may be anticipative and we do not assume the predictability of Qt^^i, 
which has no more meaning than approximation to Qs- 
Let 



E 



dsdr 



(37) 



We will apply the integration- by-parts formula d + 6 times for s > f„ , by taking advantage of the nondegeneracy 
of {{M^ + W^,F^)},>t^,nGN when < 1 , and that of the decay of exp{i(C^' - Coc)[u^'^]} for s < i„ as 
well as the integration-by-parts formula for F^o in order to obtain integrability in {u, v) of /"(m, v) of (37). We 
need several steps to achieve this plan. 
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(a) (Mp + Woo,Foo) and C" — Coo appear in the factorization 

e^iu)-^ooiu, v) - cxp (lAinu] + ^iC: - Coo)[w^'] ) exp ( iWo.[u] + iF^oM 



where 



= cxp(i{M:' + Woo)[u]+iFoo[v] 

= exp(i(Cr-Cr)K^ 
C = exp(i(Cr-Cr)[u®2; 

(b) By the Leibniz rule, the density function rk exp(— Is[u®^]) of the fcth Malhavin derivative of exp(— 

is a hnear combination of the terms of the form 

A = Dr,,...,r,IsK^^'^---'^Dr,^.-i+U-,r,JsK^] exp(-I, [u®^])^ 

where 1 < ki < ■ ■ ■ < km-i < km = k and I < m < k. We denote by e a positive number and we will 
make its value as small as we want in the context. It is possible to choose such an e because we only 



change its values finitely often. Let u {0} and let Cu — 



u\ ^u. 



l~S 1-s 
■ exp(-I,[u®2])|y|2„« 

for ri{e) = £{1 - e)-\ 



g)l+';(e 



^{l-e) 



(c) For every m and e G (0,1), I<;[u®^]'"^^ exp(--Is[u®^]) is bounded since Is is nonnegative-dcfinite and 
supj.>o \x\"^e^^ < oo. This and the inequality in (b) together with [Al] (i)-(ii) imply 



ess. sup < C(p)|m| 

ri,...,rfc,sG(0,l) 



2me 



for some constant C(p). 



(d) (C" - C^)[u,u] is bounded in u e A° whenever ^„ < 1, due to [Al] (iii). Therefore, by [Al] (iv), 

{||i:)''ll"l{5_^<i}||p; s e [0,1], u g A{d,q), n € N} is bounded for every p > 1 for A: < ^. We notice that 
due to (33), the first term on the right-hand side of (27) is 0(r„) in norms. 

(e) The Sobolev norms of {DrMg}(^j..s)e[a.i]^,neN are bounded. 

(f) sup„gp,r-2 l(t,-ify]is)l(t,-i.s]ir) dsdr < oo. 

(g) In the estimation of A in (b), we can re-estimate the factor lg[u^^]"^^^~'^'> exp(— Is[m®^]) as 

I,[u®2]'"(i-0exp(-I,[w®2]) < C(k) |^.|-2''^(I,„[ef ])-'= 

whenever ^„ < 1, for any fc G N. It will be applied for s < i„. 

(h) With (a), (c), (d), (e) and (f), we repeatedly apply the integration- by-parts formula based on (M" + 

Woo,-Foo) at (36) for s > i„. For s < t„, we apply the integration-by-parts formula based on Foo (for all 
V G M'^i) with the help of (d) and (g), to obtain 

sup sup \{u,v)f+^^''\I"{u,v)\<oo (38) 

" iu,v)eA'l{d,q) 
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for some e' G (0, 1). We note that the differentiation with respect to {u,v) in (37) does not change the 
estimate essentiaUy. Note also that I^{u,v) is like a 4i/i-order polynomial in {u,v) in growth rate, and 
that£-4-e' + 



Let 



Obviously, the Burkholder-Davis-Gundy inequality applied under (33) implies 

II sup |^"|||p 0(r„) 
te[o,i] 

for every p > 1. 

For p > 1 and e > 0, thanks to (34), we can find an increasing sequence Tk {k ~ 0, 1, K) in [0, 1] such that 
= To < • • • < Tk = 1 and 



r-^E 



< e 



uniformly for large n, where fc(ij_i) = maxjfc; Tk < ij-i} depending on j and n. Moreover, 



A;=l 

o(l) 



-o(l) 



since the stable limit is centered. Here the first equality was due to C-tightness of the sequence 
Since e is arbitrary, as a consequence of the above estimates, we obtain 



r-l /.I 

^| / E 

10 Jo 



dsdr = o(r„) 



as n — )■ oo. Even in the case involving derivatives in (u,w), following the same argument, we obtain 

= 0(1) 

as n — > oo for every (m, v) S R'^. 

6.2.2 The terms involving D^C^ and others 

By definition, 

' K-{s,r)^DrCyr = ^ l(t^._,,,^](s)ii:"(s) f\^t,^_,^,^{r)K-{r) ® D^C^dr. 



(39) 



^Here we have an index larger than necessary. But it becomes d + 1 — e' for some other terms. 
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With scaling by r„ , 



E 



^0 



K'\s,r)[ule-^{u)m^{u,v)^n^DrC:[u®^]®Q, 



dsdr 



(40) 



r-'iTr* / E 
'o 



ds + o(l) 



K ] + 



-Tr* / E 
2 io 



unAi(rft) +o(l), 



where DtC^ = hnis-|-t DgC^. For the last equality, the first integration in the last line can be approximated by 
that with respect to fi". If we realize the weak convergence of random variables including e"'(u) taking values in 
the space of continuous functions with uniform norm as a.s. convergence, then the integrand of the last line can 
be approximated by £^[e"(w)^'oo(M, v)-il)nK"{t, t) ^DtC^ Qt] uniformly in t with the help of the truncation. 
By conditioning, 



Therefore 



E 

= E 
^ E 
= E 

E 



e^{u)^ooiu,v)K^{t,t) ^ DtC^ ® Qt 



*oo(m, v)K^{t,t) DtC^ Qt 



exp <; iW^[u] - -Coo[u®'] + iF^\v\ \ K^{t,t) DtC^ Qt 



exp {iu ■ z + iWoo[u] + iFoo[v])(l){z;0,Coo)dz {t,t) (g) DtC, 



t 



K"{s,r)[u],e^iu)-9^{u,v)^n^DrC^[u'^^]®Q,, 



'-E 



expUu- z + iW^[u]+iFo^[v])(j){z;0,Coo)dzTT* / {t,t) ® -DtC^ ® Qt ^i{dt) 



dsdr 



1 



u®^] +o(l). 



Moreover, DtC^ = in this case. 

We can do with the terms involving either DrWoo, DrFoo, DrDgWoo, DrDgCoo, or DrDsFoo in the same 
way to obtain 

^^'°{u,v) := lim r-^<i>^^°{u,v) 

n— J-oo 

= Jim_ r-^E [L'l{u)^oo{u, w)V'n] 

exp (iu- z + iWao[u] + iFoo[v])(j){z;0,Cac) dz Tr* f K°°{t,t)[u] at,t{iu,iv) n{dt) 



'-E 
2 



E 



exp [iu ■ z + iFao[v\)4'{z\ Woo^ Coo) dz a{iu, iv) 



(41) 



where at,t{iu,iv) = liuisp at^siiUjiv) and 



a{iu,iv) = -Tr* / K°°{t,t)[iu](g at,t{iu,iv) ij{dt). 



(42) 
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The random symbol at^t.{iu, iv) can be expressed formally as 



By tracing the derivation of the above limit with the Leibniz rule, we obtain in a similar manner 

1 fta TP \ T n 



n— >-oo 



exp [iu- z + iWoo[u] + iF^[v])(l){z;0,Coc) dz Tr* j K°°{t,t)[u] ® at^t{iu,iv) dt 
exp (m • z + iFao [v\)4>{z] Woo^ Coo) dz a{iu, iv) 



n— >oo 



Applying the integration- by-parts formula at (40) or its derivatives in the same way as we reached (38), we 
obtain 

sup sup \{u,v)f+'-''r-'\^'^''{u,v)\ < oo. (43) 

" («,i>)eA?,(d,q) 



6.3 Asymptotic expansion of the double stochastic integral 

We are now on the point of presenting our results with the aid of the preceding subsection. The density p„ is 
given by (11), (10), (8) and (42). 

Theorem 3. Suppose that Conditions [Al], [A2]'i and [A3]^ are fulfilled. Let M,7 € (0,oo) and 6 € (0,1) be 
arbitrary numbers. Then, for some constant Ci = C{M,j,6), (13) holds as n ^ oo. 

Proof. Inequality (12) has been verified in the present situation by (43). We can verify [Bl], [B2]^, [B3] and 
[B4]f m.n for (m, n) — (5, 2) to apply Theorem 1 (b). [Recall that now i is different from in Theorem 1.] We 
apply [10] for [Bl] (ii), however we still need the joint convergence assumption [A2]'' (iv). □ 

We shall present a version of Theorem 3. 
[Al]^ Conditions in [Al] hold except for (iii). 

s„ : — > M is a positive functional. 
[A2] Condition [A2]'' holds, replacing its (ii) by 

(ii) F^ e De+i^ooi^'''), Wn £ D,+i,^(R''), iV„ € D,+i,oo(K'') and s„ G D,,oo(K). Moreover, 

{o o o 

II Cn \\e,p + \\ Wn \\i+l,p + II Fn \\i+l.p + ||A^n|U+l,p + ||s„||f,p > < OO 

for every p > 2. 
The nondegeneracy of (M" -I- Woo, -Foo) will be necessary. 
[A3] (i) There exist a sequence (i„)„GN in [0, 1] with sup„ t„ < 1 such that 
suptx^ P[det (T(Mj"+Woo.Foo) < *n] = 0{r'^) as n — > cx) for some v > £/3. 

(ii) For every p> 2, limsup^^o^ E[s:^p] < oo . 
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Theorem 4. Suppose that Conditions [Al]^, [A2] and [A3] are fulfilled. Then for any positive numbers M and 
1, 



sup A„(/) 

/e£(M,7) 



o(r„) 



as n —> oo . 



Proof. As in the proof of Theorem 3, we will verify [Bl], [^2\ej, [B3] and [B^t,m,n for (^',m,n) = (d + 3,5,2) 
to apply Theorem 1 (b). Define ^„ by 



'[041 



|t-s|3/8 



dtds. 



where c is a constant given in the proof of Theorem 2 and L* is a sufficiently large constant. Here we can choose 
a number q that is smaller than the given q. Now the rest is to verify (12) for d + 3, that is, (43). There 
were two steps to reach (43): (38) and the argument just before (43) concerning (40). The reasoning is quite 
the same in those cases, so we will show (38). However we need to do it under [Al]'', [A2] and [A3] this time, 
not under [Al], [A2]'' and [A3]''. Obviously we have [A2]''. Condition [Al] (iii) is satisfied due to the definition 
of the above ^„ with suitable L* . 

In order to estimate (36) once again under the present assumptions, we can follow (a)-(g) in Section 6.2.1. 

Let 



V 2 



1 + 4A(M„+vF^,j?^)s; 



for s > tn. Then the integrand of (36) is decomposed as 



E 



E 



K'\s, r) [u] , (u) (w, v)^P^iDrMs H 



K'\s,r)[u],e'l{u)'^ oo{u,v)^pn^n,siDrMl\u]® Q, 



+ i?„(s,r) 



with 



\Rn{s,r)\ < C{p)r-"^ sup|!l-Vn,.'|lp r-'Y.Mt,-ut,Mkt,-us]ir) 



J 

for all n, s and restricted {u,v), where 6 = 4 and C{p) is a constant independent of them but on p g (l,oo). 
Taking a small q > 1/3, we have v — {d + 1 + t)q > (even for 4 = 5). We can apply the integration-by-parts 
formula repeatedly as in (h) of Section 6.2.1 with truncation by ipn''Pn,s instead of ipn, and then (38) follows 
from [A3](i) by choosing a small p > 1. It was the estimate for the terms concerning DrM". We can do the 
same kind estimate for the terms involving DrC^ and others to finally obtain (43) while 6 = 5 in this case. □ 



7 Quadratic form of a Wiener process 
7.1 Asymptotic expansion 

The quadratic form of the increments of a diffusion process with a strongly predictable kernel plays a central 
role in the inference for diffusion coefficients. The case of the Wiener process shows what is most essential in 
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the analysis. Let a E C^{M.), the set of smooth functions with all derivatives at most polynomial growth. We 
write Ij = l(t,_i,t,], ^j/n. Let 



In this section, w = {wt)t£[Q^i] denotes a standard Wiener process starting at wq. Then 



C? = n / Vl,(s)4aK._j2( / dwrY ds 

Jo J ^Jij-i 



and we see 



j Jtj-l Jtj-\ 
m ^ — ^ \ n 



n 

j:tj<t 



2 / aiwsYds = C° 
In this example, we will consider 



2 



Obviously 

F„ 2/ a{wsfds^C^=C^ 



1 

This setting is natural in estimation of the diffusion coefficient (volatility), where M" becomes the "deviation" 
of the estimator for the cumulative variance of the system and Fn is an estimator of the "asymptotic variance" . 
Let a{x) = a (a;) 2. In order to obtain asymptotic expansion, we will assume the nondegeneracy condition 

[HWl] inf^eR|a(a;)| > 0. 

In application to statistical estimation of volatility, this condition is translated as the uniform ellipticity of the 
diffusion process. For the nondegeneracy of Fqo, we need the following condition. 

[HW2] X^tli l^*Q^('"^o)| > 0, where wq is the initial value of w. 

The initial value wq can be random but has a compact support. 
Set 

•^^ - ^ f a{w,)^ds = C^ = Coo-^ ^, 





£0 = 2/ aiw.yds = = Coo^F, 
Jo 

£1 = ^ ^ a{w,)^ds(^J^ a{wsfds^ 
0'{'Wt)(^ / aa {wiy)diyj dt 



r-l 

€2 



£3 = / a{wt) {aa" + {a'f}{w^)dv dt. 
Jo Jt 

Then the random symbol a is given by 
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The asymptotic expansion is done by 



Jn 



where 



■p{z,x) = E 



= E[CiS:,{€oM{z(j){z;0,x)} 

-d, (252 - 4d^y {E[€2SA€omz; 0, x)} 

-a,(2af-49,){£;[e:3(5,(e:o)](/)(z;0,x)} 

= E[€id,{^o)]dl{z(biz;0,x)} - m{dlE[€26M]}d.(biz;0,x) 

+4{d,E[€36A€o)]}d,(b{z;0,x) 
=: pi{z,x) +P2iz,x) +P3{z,x). 

Remark 7. In order to obtain rough evaluation of the terms involving S^^ we may apply the IBP formula, the 
kernel method, or other methods. 

Theorem 5. Suppose that [HWl] and [HW2] are satisfied. Then for any positive numbers M and 7, 

sup E[f{M^,Fn)]- f{z,x)pn{z,x)dzdx 
fee(M,'r) Je^ 

as n ^ 00, where £{M, 7) is the set of measurable functions / : - 
for all z, X G M. 



satisfying |/(z,x)| < M(l + \z\ + \x\)^ 



7.2 Proof 

7.2.1 Representation of the Hmit variables 

The variable admits the representation 

Ml" = ^ aK_j((V^A,«;)2-l), 

where AjW — Wtj — Wtj_-^- For Ct-— V^{pt ~ have 

Cr = H V \^A^s)^n^a{wt,_^f\(^l dw^ - {s - t,^r)^ds 

" X! / '^[o.t]{s)'inVna{wt^_,)'^\( [ dwr) -(s-tj_i)|ds 
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Here we know that the supremum of ^^Op{n ^Z^)" in i g [0, 1] is of Op{n ^/'^). With the same argument, we 
have 

V^{Fn - F^) =Foo . 

We should specify the distribution of 

(Moo, Coo) 

For computations, we wih use the discrete fihration F" = (^")te[o,i] with = -7^[nt]/n- The bracket for F" is 
denoted by ((•)); though it depends on n, we suppress it from notation. Let Hi[x) — x and H2{x) — {x^ — l)/^/2. 
Denote AjW — Wtj — f^tj^i , which depends on n as well as j. The discrete version of Af " is given by 



3-tj<t 

o 

The principal part of C " is F"-martingale 



The discrete version of w is denoted by w" — 'W[nt]/n- Then we have 



((M2.",m2-")), = - V a(«;,^_ J2 ^-p 2 f a{wsfds 



j:tj<t 

lw-,M^n}t = (fc = 2,e) 



{{M^'-,m-h - 1^ E ^"''^/«(^^)'^^■ 



Obviously, the orthogonality between those martingales and any bounded martingales orthogonal to w holds. 
Therefore, we obtain the following stable convergence with a representation of the limit: 



where (i?, i?') is a two-dimensional standard Wiener process, independent of defined on the extension f2. In 
particular, 



(Moo, Coo) (y V2a{ws)dB,,J -^a{wsfdB,+j -a{w,fdB'^^, 

so that 

Coo(w,Moo) =E[Coo 1-^] = ^ a{wsfds(^j^ a{wsfds^ 



Thus we have 



Coo (2;) (700(^^,2:- M/'oo) = Coo (w,z) 

Az 



f a{'Ws)^ds(^ J a{'Ws)^ds^ 
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By definition of the variable in this example, we have Foo{uj, z) = and 7Voo(w, z) = 0. From above computations, 
the random symbol g_{z^ iu, iv) is given by 



q_{z,iu,iv) — -5- / a{ws)^ds( f a{ws)'^ds\ (iu) 



3 7o 

In order to obtain the random symbol as^riiu,iv), we note 



DrC^ ^ ^/ aa'{w,^)diy l[r<s}, 

J r 

J S 

DrDsCoo = DrDsF^^4 [ {aa" + {a'f}(w^)diy. 



Therefore, 



2u 



(^ — 2u^ + Aivj J aa' {wi,)dv J aa'{w,^)di' 
+ — 2u^ + 4:ivj J aa' {wu)di' j aa'{'Wy)dv 
+ (-2^2 + 4m;) [ {aa" + {a'f}{w^)dv 



and 



Ut^tiiu^iv) = (^ — 2u^ + Aiv^ (^j^ aa' {'Wi,)dv^ 

+ (^-2u^ + Aiv^ [ {aa" + {a'f}{w^)dv. 



Thus 



f-i 

a{iu,iv) = j a{wt)iu at^t{iu,iv) dt 







2 

dt 



iu(^ — 2u^ + Aiv^ J a{wt)(^j aa'{wu)di^ 
+iu(^- 2u^ + Aiv^ I a{wt) {aa" + {a'f}{w„)dv dt. 



Remark 8. From computational point of view, only rough simulation for the conditional expectation of a{iu, iv) 
given Frxi will be necessary to obtain the second-order term. This is called the Hybrid I method. 

Thanks to the nondegeneracy of a, it is easy to verify [Al](ii); otherwise, we would be involved in a tedious 
large deviation argument which we did not want to pursuit here. Other conditions in [Al] are also easy to prove. 



7.2.2 Nondegeneracy 

Here we will briefly discuss the nondegeneracy in Malliavin's sense. We have 



DrMl^ = V^}j2a(«;t^_J / dwA^(^t,^^M.t,At)ir) 

j^l \Jtj_lAt / 

/n2_]a'(wt,_i)l(o,t,-iAt]W ( / dw,)^ - {t^-i At ^ tj^i At) 

j=l V Jtj-iAt 

Di{n,t)r+D2{n,t)r. 
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Let 'r]j{t) = y/n{w{tj At) ~ w{tj^i At)) and 



^j{t) = n\^{witjAt)-w{tj^iAt))-{tjAt-tj^iAt) 
Then 

n 

D2{n,t)r = n-^J2"''i^tj-i)'^{o.t,-iAt]ir)^jit) 
where = (^j-i A t,tj A t]. For a while, we assume t £ {tj}j. Hence 

^ n - \ ^ 

aii{n,t) := (TM" = - 2a{w{tj^i))T]j{t) + —= a' {w{tk-i))^k{t) 

where we read J2k=n+i ■■■ Moreover, 

" r 1 " 1 /" 

ai2(n,0 (M;\Foo)h = V 2a(u;t^._ J77, (t) + ^ V a' {w{tk-i))Ut) ■ 4 



and 



0-22 (i) 



n 2 



4 / aa'{ws)ds 



dr. 



The Malhavin covariance matrix of {MJ^,Fao) is then given by 



aii{n,t) (712 
0-12 0-22(1) 



Let 



Let 



CTii(n,t) ai2{n,t) 
ai2{n,t) (J22{t) 



CTll 



1 " 



3 = 1 



-I 2 , n 



2a{wt^_,)rij{t) 



1 1 
n ^-^ Jn ^-^ 



and 



0'i2(rt, 



,i) = E ^ E a! {w{tk-x))ik{t) ■ 4 / aa'K)ds(ir 



(7(ri, i) 



(Ti2(n,i) 0-22(0 



We shall show 



|cr(n,t) -a(n,t)|| = 0(71 2) 



for every p > 1 and uniformly in i. 
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Let X denote the set of sequences J^'^'^ = {J^]) of multiple Ito stochastic integrals taking the form 



' tj-i J tj-i 



where {a^j^'j i = 1, i^, j ~ 1, n, n G N} is a family of progressively measurable processes. In the following 

lemma, J^j^ ■ ■ ■ J^^J^ , J^ll ' ' ' '^'nkl ^''^ ^^"^ g&c\\ of them has a|j*^- ■ which may possibly differ from those 
of other indices z^'s and /i's even if the values of indices coincide each other. 

Lemma 5. Suppose that 



sup 

je{i,...,n}, neM, 7e{o.i, 

ri,....,r^,se[0,ll 



\Dr,,....,rM\\p<^ 



for all O = a|j*j, and a^*^- j(s), and for every p > l}^ Then 

(a) Suppose that b^^^, are Tt^_^-measurahle. Then for vi, Vm, fJ-i, fJ-q G 



Jl,.... Jm 

(b) For e N, 



O 



i/2 



(m) t(j^,„) 
■ "n "^n j„ 



,m/2 



1 

T/ie constants in the above estimates depend only on the given supremums. 

Proof. First we will show (a). We use the L^([0, r])-orthogonality between l(tj_i,tj] and l(tfc_i,tfc] foi' J 7^ ^- If 
the number of single j*'s is a, then the outside summation has at most rt" x terms of such type. The 

a times IBP-formula for those single j*'s deduces the order n"*"/^ if ki,...,kq are different from any of j*'s; 
otherwise, we also get rt^^/^ in each IBP-formula. Note also that the derivative of 6's do not change the form 
of "martingale", besides it gives After all, total order becomes 



In a similar way, we can obtain (b). 
For example, we apply (b) for 



By Lemma 5, we see 



and 



= 2a{wt^_JxnJ j aa' {ws)ds^dr. 



1 " / 1 " 



k=j+i 



n f 

y22a{wt^_^)r]j{t) / 4 / aa'{ws)ds dr 
,=1 J I At) Jr 









p 







□ 



^^^7 = denotes the case with no derivative. 
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as n — > oo for every p > 1. Consequently, we obtain (44). 
Now we have 



det a{n, t) 



1 " 

n ^ — ' 



n2 ft V 



71 r 



aa\ws)ds 



dr 



E 7^ E x-^ / 4 aa' 

E E ^'(^tk-imkit)] ■ I 4 f aa' 



{ws)ds 



dr 



Ws)ds dr 



> 



1 " 

-E 

i=i 



n2 ft V 



2a{wt^_,)r]j{t) 



1 2 



aa'{ws)ds 



dr, 



(45) 



where we used the Schwarz inequahty as weh as |-/j(t)| < l/n. 
Let tn = 1/2 and cq = inf^jgR |a(a;)|. Define s„ by 



So 



1 



aa'{ws)ds 



dr. 



In particular, s„ does not depend on n in this case. 

We consider the system of stochastic differential equations: 

dwt — dwt, 
d ft = 2a{wt)dt. 

For this system, we have Vq = 2a{w)d2, V\ = di, where di and 82 correspond to w and /, respectively. We see 
that Condition [HW2] together with [HWl] applied at w{0) implies the Hormander condition for this system; 
see for example Ikeda and Watanabe. The boundedness of derivatives of the coefHcients assumed there can be 
removed in our case by means of a large deviation argument. In particular, Foo = fi is nondegenerate, even up 
to t — 1/2, that is. 



(46) 



Since M" and Fn are asymptotically orthogonal in the i7-space in the sense of (45), the convergence is sufficiently 
fast as shown by (44), and so is nondegenerate as (46), we conclude the uniform nondegeneracy of (M",Foo) 
for t > 1/2, as follows. Due to ai^M^.F^) ^ (j{n,t) by definition, for every K >0 and = mva{tj\tj > 1/2}, 



sup P 

t>l/2 



det(T(M;',_F^) < So 



< P 



< P 



deto-(n,tJj) < 1.5. 



So 



det a{n, tj^) < 2so 



+ 0(71-^) 



0{n 



as n — > 00. 



7.2.3 Proof of Theorem 5 

Theorem 5 now follows from the results of the preceding subsections. 
7.3 Studentization 

We shall consider the expansion of the expectation E[g{Fn ^A/")]. This form corresponds to a studentizcd 
statistic in the statistical context. The contribution of the principal part is given by 

j g(^-^^<j){z;0,x)E[6^{€o)] dzdx = J g{z)<j){z;0,l)dz J p^°°{x)dx = J g{z)(l){z;0,l)dz 
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Let g G 5(]R). For the second-order terms, we have 



E 



r 



x)dzdx = J g(^-^^E[€iS^{(to)]d^\^z(j){z;0,x)^ dzdx 
= J ^g"(^^^E[<Li6,{€o)W{z;0,x)dzdx 
= I g"{z)E[Cid,{€o)]^Hz; 0, 1) dzdx 

^[£1,5,(6:0)]^ dx ■ [ g{z){z^ ~ 3z)(/.(z;0, 1) dz 
I g{z){z^ -3z)(f){z;0,l)dz 



Here we used 



J E[€i6^ieo)]^ dx = Je 



£1 



= E 



I d.,E 
£1 



£1 



dx 



dx 



Define polynomials by 

for a /3-times differentiable function g. Set 

For g e 5(M) and any smooth functional 1). we have 

= y g(-^)af{£;[s)4(e:o)]a;-^(i+")a;^^(y; 0,1)1,^,,-!/.} dzdx 

= / E ^^■^ (;^' 5^"^ (;^) [^'^.(Co)] x-^(i+")9,"0(y; o, i) } dzdx 

= / E^/3,.(y,^)5^'^H2/)i?[s4(e:o)]a:-^"5,"0(y;O,l)d2/dx 

= / ff(2/)^(-a,)('^){9,"0(y;O,l) / P0^,(y,^)E[^5.,{€^)\x--^'' dx] dy 

= I g(2/)^(-a,)('^){5„Xy;0,l) / E[Q^,p,,(y,-^)^5,{€o)\ dx] dy, 
J J v'-o 

therefore we obtain the formula 

[-^)d'^dl{E[^54^,) 



4>{z\ 0, x)] dzdx 

9iy) E(-5?y)''^'|5."<^(y;o, i)E\Q^^pJy., -^)^] ] 



dy. 
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By definition, 



Qa.l,o{y,x) = 0, QaA.liV'^) = -jV^ 

3 

Qa,2fl{y,x) ^ 0, QaaAv.x) = -yX 



,0+2 



,Q + 4 



Applying the formulas, we have 



g[ -y=.jp2{z,x) dzdx 



-Sdy{ydl^{y-0,l))E[€-'-€2] 
+l2dy(ydyC^{y-Q,l)E[<Co'^<l2]) 
-Adl(y^dy<i>(y-G,l)E[<L'^'^<L2])\ dy 



and 



g \ —^jP3iz,x) dzdx 



After all, we obtain 



qn{z) 



giy)E[€„-'€2]{12y)^iy;0,l) dy 



{^)dz (292 - 49,) {E[€3S,{>tomz; 0, x)} dzdx 
g{y) [ - 2930(y;O, 1)£;[g:o ^£3] - 29, (y9y0(y; 0, l)ii;[e:o '£3]) 
5(y)£;[e:o^'J^3](-2y)0(2/;O,l)dy. 

= 0(z;O,l) + ^fi?[e:o^G:i](z3-3z) 



+s[(!:o^g:2](122) 

+E[1--'€-i]{-2z)y{z-Q,l) 

— 1/2 

as the second-order approximate density to the distribution of F„ ' Af". 

8 Quadratic form of a diffusion process 

We shall apply and extend the result in Section 7 to the quadratic variation of a diffusion process. It is called 
a realized volatility in financial context recently. We consider a diffusion process satisfying the Ito integral 
equation (1). Here b and a are assumed to be smooth with bounded derivatives of positive order. 

For simplicity we only treat the one-dimensional case; multivariate analogue is straightforward. Even exten- 
sion to Ito processes is also possible but the descriptions would be involved. We write bt for b{Xt) and at for 
a{Xt). The Ito decomposition of at — a{Xt) is denoted by 



a^P'd'w^ 



Though a^s"^ and at'^ have a simple expression with 6, a and Xg., those symbols are convenient to simplify the 
notation. This rule will be applied for other functionals. 
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We consider the quadratic form (2) of the increments of X with strongly predictable kernel. Here we are 
interested in the asymptotic expansion of the normalized error 



y/n{Un - Uoo) 



for Uoo in (3). We are assuming c G C*°(R). 



8.1 Stochastic expansion 

We will need a stochastic expansion of Z„. 

Lemma 6. Z„ admits the following stochastic expansion: 



\/n 



where 



Mr = V^Y.'^ct^-A_^ 



tj — iAt J tj — i 



dWrdWs, 



and 



.dw.dwt 



j=1 '^ij-l 
n n 

j— 1 J tj-l J tj-l 

1 [0] 2 1 [1] [1] , /i\ 



- tj^ijdwt 



-ffere om(1) denotes a term of o{\) as ri —> oo with respect to fi>s,p-norms of any order. The families {M"}tg[g x],ngN 
and {Nn}n<EN are bounded in every Ds, p-norm. 

By somewhat long computations, it is possible to obtain the above lemma. We omit details. 

8.2 Asymptotic expansion 

For a reference variable, we will consider 



1 " 



where P G C^(R,M''i)- The resuhs wih be the same in these cases. It is statistically natural to consider those 
functionals because, for example, Foo gives the conditional asymptotic variance of the estimation error Z" as in 
Section 7. We will derive asymptotic expansion of the joint distribution of (Mf ,F„). 
Let a{x) — c{x)a{xY . Let 



Va{xi,X2) 



h{xi) - \(j{xi)dxi(T{xi) 



and Vi{xi,X2) 



a{xi) 
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for a;i € R and X2 € M''^ . The Lie algebra generated by 

Fi, [V,,V,] (*,j=0,l), [V,,[Vj,Vk]] (z,j,fc = 0,l),.... 

at {xi,X2) is denoted by Lie[Vb; Vi](a;i, a;2)- 

Assume that supp(Xo) is compact. Moreover, for nondegeneracy, we assume 

[HI] inf^eulaWI > 0. 

[H2] Ue[Vo;Vi]{Xo,0) =R^+'^' a.s. 

Remark 9. Under [HI], both ess. inf |(t(Xo)| > and ess. inf |c(Xo)| > 0. Then [H2] is equivalent to the linear 
hull L[9*^/3(Xo); i e N] = R'^^ a.s. It is rather simple but we prefer to keep [H2], which is suitable for more 
general form of Foo- 

Remark 10. Condition [HI] is usually from the uniform ellipticity of the diffusion process Xt and a reasonable 
choice of the estimator for the quadratic variation. In this sense, it is a natural assumption in statistical context. 

Remark 11. Consider a (1 + di )-dimensional stochastic integral equation 

Xt = Xo+ f Vo{Xs)ds+ f Vi{Xs)odws, te[o,i]. 
Then Xi — (Xi, i^oo), and the nondegeneracy condition entails the nondegeneracy of Fqo in particular. 

^ ^ o 

We see Wqo{z) = and ^00(2) = 0. It is necessary to specify the limit {Moo, Coo, Noc)- The "martingale 
part" of Nn with respect to F" is given by 

N" = 6n ^ ct._itTt,_iCr|^^Li / / / dwudwsdwt 

j:tj<t "'tj-l "'tj-l "'tj-l 

/t j /• t J 

dwt + 2n ct^_^at,_^o'f^_^ / (t-tj^i)dwt 
j:ij^E -J-l j:tj<t "'tj-l 

E ^-i<-i r f dwsdt. 

^.4. ^4. '/ti_i./ij_i 



-n 



We redefine M^'" and M^'" by the same equations in Section 7.2.1 but with a(Xt ) in place oi a^Wt.^). Then 



\ni] 
n 

j-tj-i<t "'0 
1 « 1 c ft 

((M«'",M«'")), = ^ E aiXt^_,r ^ aiX.fds 



((u;",7V))t ->P [ ksds 
Jo 



{{m\m--))t - 1^ E aiXt^-.f^'lf^aiX^fds, 



((M«'",iV"))t 0, 



((iV",iV"))t -^P / qids 



t 

2, 
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as n oo for each t S [0, 1], where R+-vahied process qt takes the form 

2 t W u 

Qt = P{ct,cl\bt,at,crl'} 

for some polynomial p; it is possible to give an explicit expression of p, however we do not need the precise form 
of qt later. The orthogonality of M^'", M^'" and to any bounded martingale orthogonal to w is obvious, 

o 

thus with a representation of C* " in Section 7.2.1 with a{Xt-_-^) for a{'Wtj_-^), and those of M" and N„, we 
obtain 

(Moo,Coo,iVoo) ( [ V2a{Xs)dBsJ ^a{XsfdB,+ [^a{X,fdB'^, 

^Jo Jo -J Jo -J 

/ ksdws+ f ^/^[^^dB'^+ f\sds), 
Jo Jo Jo ' 

where {B,B',B") is a three-dimensional standard Wiener process, independent of J^, defined on the extension 
f2, and 



ht = ctb^ + Ct6[^l at - ^cf' - c[^' ata^^'^ . 

and 

kt = 2ctbt<Tt +ct<Jt<Jl^ - ^c^l^al. 

Since 

Noo{z) = / ktdwt+ / /itdt, 
Jo Jo 

the random symbol g_(z, iu, iv) is given by 

a{z,iu,iv) — — f a{Xs)'^ds( f a{Xs)^ds\ {iu)'^+iu j ktdwt + iu f htdt. 

3 Jo ^Jo ' Jo Jo 

Let us find the anticipative random symbol a{iu,iv). Recall that a{x) — a(x)'^, 

^2 f a{Xt)dt, Coo = 2 / a{Xt)dt, ^ ( f3{Xt)dt and Woo = 0. 

Jo Jo Jo 

The random symbol ag .^{iu,iv) admits the expression 
(Ts^r{iu, iv) 

= u^^ a'{Xt)DrXtdt(^-u^ a'{Xt)DsXtdt + i 13' {Xt)[v]DsXtdt^ 

+ a'{Xt)DrXtdt + i (3'{Xt)[v]DrXtdt^(^-u^ a' {Xt)D,Xtdt + i j ^ {Xt)[v]DsXtdt^ 

f {a"{Xt)DrXtDsXt + a'{Xt)DrDsXt}dt + i j {P" {Xt)[v]DrXtDsXt + P' {Xt)[v]DrDsXt}dt 

JrVs JrVs 



for r < s, where the prime ' stands for the derivative in xi S K. The processes DgXt and DrDgXt are determined 
according to routine; D^Xt satisfies the equation 

D,Xt = a{X,)+ f b'iXt,)DsXt,dh+ f a'{Xt,)D,Xt,dwt, 

J s J s 
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for s < t , and 



DrDsXt = a'{Xs)DrXs+ b"{Xt,)DrXt,DsXt,dti+ b'{Xt,)DrDsXt,dti 
+ I a"{Xt,)DrXt,DsXt,dwt, + / a'{Xt,)DrDsXt,dwt, 

J s J s 

for r<s < t. Those equations form a graded system of partially linear equations; therefore the L^-estimates of 
the solution are at hand. Now we obtain the anticipative random symbol 



(T(m, iv) 



iu a(Xs)(Js.siiu, iv) ds 



with 



a,,,(m,fi;) = {-u^J a' {Xt)D,Xtdt + i j (i' {Xt)[v]DMty 
-u" I {a"{Xt){DsXt)^ +a'{Xt)DsDsXt}dt 

J S 

+1 f {P"{Xt)[v]{DsXt)^ + p'{Xt)[v]D,D,Xt}dt 



As before, define the total random symbol a by (10) and the density function pn{z,x) S C°° (M^'*'''^ ) by (11). 
By a quite similar argument as we proved Theorem 5, it is easy to obtain the following theorem. See [32] for 
details. 

Theorem 6. Suppose that [HI] and [H2] are satisfied. Then for any positive numbers M and 7, 

sup E[f{Zn,Fn)] - / f{z,x)pn{z,x)dzdx 
/e£(A/,7) JRi+''i 



as n ^ 00, where £{M, 7) is the set of measurable functions f 
for all {z,x) e R X R'^i. 



satisfying \fiz,x)\ < M(l + |2:| + |a;|)^ 



Remark 12. The hybrid I method with a rough Monte-Carlo method in the second order term is useful in the 
application of the expansion formula to numerical approximation. Obviously, the asymptotic expansion applies 
to statistical hypothesis testing. We will show its applications to prediction and option pricing in other papers. 

Remark 13. While our method working in the mixed normal limit case enabled us to introduce a conditioning 
variable as Fn, it is possible to consider versions of our results without Fn. It will reduce the regularity condition 
of smoothness, that is, indices of differentiability of other variables. Of course, in that case, we only obtain a 
single (not joint) expansion. 

Remark 14. Conditional limit theorems are in our scope. Indeed, it is also possible to obtain asymptotic 
expansion of the conditional distribution, as it was reported at the meetings mentioned in the footnote of p.l. 

Remark 15. In [A2^] and [A2], the index of differentiability of Nn etc. could be reduced by more sophisticated 
multiple truncations. 
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